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5.1.1 Joint Probability Mass Function (PMF) 

Remember that for a discrete random variable X, we define the PMF as Px (x) — P(X — x) . Now, if we have two 
random variables X and Y , and we would like to study them jointly, we define the joint probability mass function as 
follows: 

The joint probability mass function of two discrete random variables X and Y is defined as 

Pxy( x i y) = P{X = x,Y = y). 

Note that as usual, the comma means "and," so we can write 

Pxr(x,y) =P(X=x,Y = y) 

= P((X — x) and (Y = y)). 

We can define the joint range for X and Y as 

Rxy = {(x,y)\P XY (x,y) > 0 }. 

In particular, if R x — { X i, X 2, • • • } and Ry — {x)\ , t/2 > • • • }> then we can always write 

Rxy C Rx x Ry 

l®i ^ Rx,yj £ Ry}- 

In fact, sometimes we define Rxy — Rx x Ry to simplify the analysis. In this case, for some pairs (x,, yj) in 
Rx x Ry , Pxy {Xi,yj) might be zero. For two discrete random variables X and Y, we have 

PxY(xi,yj) = 1 

(■ xi,yj)cRxY 


We can use the joint PMF to find P((JT, Y) G A) for any set A C K. 2 . Specifically, we have 

P((X,Y)eA)= p XY(x l ,y J ) 

{xi,yj)e(ArMlxY) 

Note that the event X — X can be written as {(x,, yj) : X* = X,yj G Ry }. Also, the event Y — y can be written 
as {(Xi,yj) : Xi G Rx,yj = y}. Thus, we can write 

Px Y (x,y) =P(X = x,Y = y) 

= P((X = x)n(Y = y)). 


Marginal PMFs 

The joint PMF contains all the information regarding the distributions of X and Y. This means that, for example, we can 
obtain PMF of X from its joint PMF with Y. Indeed, we can write 
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p x (x) = P(X = x) 

— P(X — x,Y — yj) law of total probablity 

UjeRy 

= P XY(x, yj ). 

Uj^Ry 

Here, we call Px ( X ) the marginal PMF of X. Similarly, we can find the marginal PMF of Y as 

Py(Y) = ^2 PxY(xi,y). 

Xi Gi?x 

Marginal PMFs of X and Y: 

Px(x) = ^2 Pxv(x,yj), for any x G R x 

Vj&Ry 

Pr(v)= J2 Pxr(xi,y), for any y G Ry (5.1) 

XiE Rx 

Let's practice these concepts by looking at an example. 


Example 5.1 

Consider two random variables X and Y with joint PMF given in Table 5.1. 


Table 5.1 Joint PMF of X and Y in Example 5.1 



o 

II 

Y = 1 

Y — 2 


- 0 

i 

6 

l 

4 

l 

8 

X - 

-1 

1 

8 

1 

6 

1 

6 


Figure 5.1 shows P X y(x, y). 
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Figure 5.1: Joint PMF of X and Y (Example 5.1). 


a. Find P(X= 0,Y < 1). 

b. Find the marginal PMFs of X and Y . 

c. Find P(Y = 1|X= 0). 

d. Are X and Y independent? 


Solution 


a. To find P(X — 0,Y" < 1), 


we can write 


P{X = 0, Y < 1) = P XY (o, 0) + Pxy( o, l ) = \ + \ = ^- 

b. Note that from the table, 

R x = {0,1} and R Y = {0,1,2}. 

Now we can use Equation 5.1 to find the marginal PMFs. For example, to find Px (0) , we can write 

Px(0) = P X y{0, 0) + P XY {0, 1) + Pxy(0, 2) 

111 

“6+4 + 8 

13 


24 


We obtain 


— x — 0 

24 X U 


Px M = < 11 x = i 


otherwise 
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& 


My) = { 


_ 5 _ 

12 


24 


y = 1 
y = 2 


0 otherwise 

c. Find P(Y — 1 l-X" = 0): Using the formula for conditional probability, we have 


P(Y = 1\X = 0) 


P(X = 0,Y = 1) 
P(X = 0) 

-ggJU) 

Px( 0 ) 


d. Are X and Y independent? X and Y are not independent, because as we just found out 


P(Y = 1\X 


°) = ^^ p ( y 


i) 


5 

12 ' 


Caution: If we want to show that X and Y are independent, we need to check that 
P(X — Xi,Y = Xjj) — P(X — Xi)P(Y = yj), for all Xi G Rx and all yj G Ry ■ Thus, 
even if in the above calculation we had found P(Y — 1\X ~ 0) = P(Y — 1), we would not 
yet have been able to conclude that X and Y are independent. For that, we would need to check the 
independence condition for all Xi G Rx and all yj G Ry ■ 


<— previous 
next —> 
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